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1 INTRODUCTION 

IXiring  the  last  several  V'2ars  considerable  progress  has  been  made  with 
regard  to  the  demonstration  of  the  basic  concepts  of  heterodyne  optical  correlation 
as  well  as  the  potential  application  to  stereo  compilation.  Earlier,  under  various 
investigations  supported  by  the  Center  for  Coherent  Optics,  USAETL,  an 
experimental  bread  board  system  based  on  the  HOC  concept  has  been  designed, 
fabricated  and  evaluated.  The  present  study,  of  which  this  document  is  the 
final  report,  deals  with  the  evaluation  of  the  feasibility  and  applicability  of 
a potential  HOC  system  under  adverse  environmental  factors  demanded  by 
field  applications.  The  main  purpose  of  this  investigation  is  to  study  the 
design  and  feasibility  of  HOC  as  a van  mounted  stereo-model  digitizer. 

The  specific  objectives  of  this  effort  are: 

(a)  To  develop  a HOC  system  model  that  is  representative  of  a potential 
operating  instrument  and  evaluate  the  complexity  of  the  system  to  meet 
the  required  performance  characteristics. 

(b)  To  evaluate  the  characteristics  and  tolerances  of  the  optical, 
mechanical  and  electronic  subsystems  from  the  point  of  view  of 
fabrication,  maintenance  and  other  operational  requirements  such  as 
vibration  and  thermal  Isolation. 

(c)  To  conceptually  design  a follow-on  prototype  HOC  system  incorpor- 
ating the  results  of  the  above  study  and  specify  the  potential  system 
characteristics. 

This  report  is  organized  into  six  chapters.  For  the  purpose  of  providing 
continuity  to  this  report,  the  principle  of  operation  of  the  concept  of  heterodyne 
optical  correlation  is  presented  in  the  second  chapter.  The  experimental 
H(X  system  is  also  described  and  its  operating  procedure  outlined.  In  the 
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third  chapter  the  various  system  model  options  are  considered  and  the  arguments 
relating  to  the  selection  of  a specific  system  model  are  included.  In  the  fourth 
chapter  the  HOC  system  is  evaluated  by  considering  the  tolerance  specifications 
of  the  optical,  mechanical  and  electronic  subsystems  as  a function  of  their 
required  performance  characteristics.  A conceptual  design  of  a protot3T)e 
HOC  system  is  presented  in  the  fifth  chapter  along  with  its  potential  advantages 
over  other  automatedoompilation  systems.  Finally  the  conclusions  and  re- 
commendations based  on  this  investigation  are  summarized  in  the  sixth  chapter. 


EIKONIX 


2 BASIC  HOC  SYSTEM  CONCEPTS 

2. 1 Introduction 

All  automated  stereo-compilation  instruments  are  based  on 
the  ability  to  match  conjugate  images  and  automatically  determine  the  parallax 
difference.  Conjugate  images  are  matched  using  image  correlation.  The  HOC 
System  is  an  optical  correlation  system  that  performs  the  two-dimensional 
correlation  of  the  conjugate  images  on  a superimposed  image  plane.  Considerable 
literature  already  exists  on  the  various  aspects  and  the  unique  characteristics 
of  the  HOC  concept  (1  ).  However,  for  the  purpose  of  continuity  in  this  report, 
a brief  introduction  to  the  concept  of  heterodyne  optical  correlation  is  presented 
and  the  basic  stereo  compilation  mensuration  procedure  is  outlined.  The  operating 
procedure  is  described  within  the  context  of  the  experimental  HOC  system  at 
the  Center  for  Coherent  Optics,  USAETL,  since,  in  general  the  proceudre  is 
highly  dependent  on  the  system  design. 

2. 2 Principle  of  Operation 

The  basic  optical  arrangement  of  the  HOC  system  consists  of 
two  projectors  each  of  which  projects  an  image  of  the  transparency  onto  a 
common  image  plane  using  coherent  light.  The  basic  configuration  of  the  system 
is  Illustrated  in  Figure  2-1.  In  this  arrangement  transparencies  1 and  2 form 
the  stereopair.  Let  be  the  amplitude  transmittance  of  transparency 

1.  The  coordinate  system  (Xj^,yj)  refers  to  the  photocoordinates  of  transparency 
1.  Slmiliarly  the  amplitude  transmittance  of  transparency  2 is  ^2^*2’ ^2^' 

The  coordinate  system  (x  , y_)  refers  to  the  photocoordinates  of  transparency  2. 

M A 

In  the  flnal  common  image  plane,  the  superimposed  amplitude  distribution 
is  given 


l(x,y) 


+ 


(2.1) 
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where 


kiX^  = X,  = y 


*^2^2  " y- 


(2.2) 


k and  k are  magnification  factors  associated  with  projectors 
X ^ 

1 and  2.  In  a very  general  case  k and  k can  also  be  made  dependent  on 

X ^ 

(x,y)  (as  in  the  case  of  rectifiers  or  anamorphic  magnifiers)  but  for  the 
purposes  of  this  treatment  k and  k are  assumed  to  be  coastant  and  equal 
to  unity.  Hence  equation  (2.2)  becomes 


l(x,y)  = t^(x,y)  + t2(x+x^,  y+y^)  (2.3) 

The  photodetector  senses  the  intensity  rather  than  the  amplitude. 

The  intensity  distribution  is  given  by  the  square  of  equation  (2.. 3)  as 


2 

i(x,y)  = 

tj(x,y) 

+ 

2ir 

+ 2tj^(x,y)t2(x+x^,y+y^)cos -y  A(x,y)  (2.4) 

where  A.  is  the  wavelength  of  the  light  and  A (x,y)  is  the  optical  path  difference 
between  two  beams.  The  third  term  in  the  above  expression  is  an  interaction 
term  resulting  from  the  fact  that  the  laser  light  illuminating  the  transparencies 
are  coherent.  One  of  the  major  objectives  of  the  measurement  procedure  is  to 
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detect  the  amplitude  of  the  cosine  modulation  represented  by  the  third  term 
in  the  above  expression.  This  amplitude  can  be  measured  by  modulating  the 
optical  path  difference  (O I’D)  A (x,y).  The  O PD  A(x,y)  can  be  modulated 
in  n.any  ways  and  more  detailed  discussion  is  presented  later  in  this  report 
on  the  significance  of  this  measurement  on  the  overall  system  performance. 

In  general,  the  measurement  of  the  peak  to  peak  value  of  the  intensity  function 
defined  by  equation  (2.4)  permits  independent  determination  of  the  amplitude  of 
the  cosine  modulation.  When  the  OPD  has  a linear  time  modulation,  the 
intensity  distribution  given  by  equation  (2.4)  becomes 


I(x,y,t)  = 


tj(x,y) 


£4  TT 

+ 2tj(x,y)t2(x+x^,y+y^)cos  Y(^o(x.y)+Vt)  (2.5) 


y 

[i 


where  V/X  is  the  frequency  of  modulation. 

The  detector  in  the  final  image  plane,  has  an  aperture  of 
area  A and  its  output  signal  at  point  P in  the  image  plane  is  given  by  the 
integral 


jUy, 


S(P,t)  = K ( |I(x,y,t)dA 


(2.6) 


where  K is  a constant  of  proportionality  dependent  on  the  photodetector 
response 


S(P,t)  = K 


tj(x,y)  dA  I 


II 


dA 


(2.7) 


Ztt 
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The  first  two  terms  of  the  above  equation  are  d,  c.  signals  while  the  third 
represents  an  a.  c.  signal  at  the  beat  frequency  (V/x). 

When  the  optieal  path  difference  A^(x,  y)  is  essentially 
constant  over  the  aperture  area  A,  the  a.  c.  part  of  the  jctector  signal  can  be 
written  as 


S^(P,t)  = 2Kcos^(A^ 


Vt)  j 


y)t2(x+Xo. 


y+y^)dA 


(2.8) 


Hence  the  a.  c.  part  is  a signal  at  frequency  V/x  having  a pha  of  A^ 
and  an  amplitude 


(X,  y)t  (x+x  , y+y  )dA 
u o o 


(2.9) 


The  above  expression  represents  the  correlation  between 
the  two  amplitude  transmittances  for  the  displacement  (x^,  y^).  Two  additional 
measurements  are  necessary  to  normalize  the  above  correlation  function.  Wlien 
only  transparency  1 is  illuminated,  the  d.  c.  output  is  given  by 


01 


Kjj'|li(x. 


y) 


dA. 


(2.10) 


Similarity,  when  transparency  2 is  illuminated 

12 


S „ = K 
02 


y) 


dA 


(2.  11) 


with  these  three  measurement  values  the  normalized  correlation  coefficient 
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can  be  computed  for  a given  separation  between  transparencies  from 


i ' 


/ tj(x,y)t2(xtx^,yty^)dA 

J A 

|Jtj(x.y)  ‘"d^jtgfx+x^.y^yj 


I 2 1/2 

) dA 


Sy(P) 

[=OlV] 


The  normalized  correlation  coefficient  C (x  ,y  ;P)  has  a maximum  value  of 

Xm  o o 

unity  when  t,(x,y)  is  a constant  times  t (x+x  ,y-fy  ) over  the  correlation 
X ^ o o 

area.  Since  t and  t can  differ  within  a multiplicative  constant,  it  is  seen 
X ^ 

that  different  exposure  levels  for  the  two  transparencies  are  of  no  consequence. 

In  practice  the  amplitude  transmittance  of  the  two  transparencies 
should  be  represented  as 


tj(x,y) 


*01  * 


•02  *‘2 '*•>'> 


where  t , and  t represent  the  average  transmittance  and  t (x,y)  and 
t2(x*y)  represent  image  structure  information.  The  presence  of  terms 
and  t do  not  affect  the  final  value  of  the  normalized  correlation  coefficient. 
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However  the  amplitude  of  the  a.  c.  signal  given  by  equation  (2.  9)  becomes 


Sy(P)  = 


. 3k//.;  (x,y)t2(x+x^,y+y^)dA 


S^^(P)  represents  a constant  amplitude  a.  c.  signal  and  S^P)  represents 
the  correlation  signal  whose  amplitude  depends  on  the  correlation  between 
the  two  transparencies.  In  practice  the  changes  in  S^(P)  are  very  small 
compared  to  the  magnitude  of  hence  the  measurement  problem 

becomes  complicated  due  to  the  limited  dynamic  range  of  the  photodetector 
array  to  be  used.  This  problem  is  overcome  by  putting  d.c.  blocks  at  the 
back  focal  plane  of  the  imaging  lenses  as  illustrated  in  Figure  (2. 1).  The 
d.  c.  blocks  in  effect  remove  the  terms  t^^  and  t^^  amplitude  of  the 

a.  c.  signal  directly  represents  the  correlation  amplitude. 

Now  let  us  consider  the  correlation  signal  amplitude  given 

by  equation  (2.  9) 


y)t2(x+x^,y+y^)dA. 


other  correlation  schemes  have  relied  on  the  selection  of  the 

maximum  value  of  S.  fx  ,y  ;P)  or  its  one-dimensional  form  to  determine 
V o o 

conjugate  image  coincidence  at  point  P.  Unlike  the  normalized  correlation 


(2. 13) 
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Figure  2.  2 Experimental  HOC  ^stem 
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coefficient  C , .V  ;P).  S.  (x  ,y  ;P)  h:is  no  unique  infiximum  value  and  its 
12  o o V o o 

value  is  dependent  on  the  average  transmittance  of  tj(x,y)  and  t2(x, y).  Hence 
the  selection  of  a local  maximum  can  lead  to  false  correlation.  This  is  one  of 
the  reasons  why  all  the  electronic  correlation  systems  as  well  as  some  of  the 
optical  correlation  systems  rely  on  tracking  to  avoid  ambiguity.  Tracking 
assumes  that  the  conjugate  images  are  always  within  the  proximity  of 
coincidence. 

Theoretically  the  normalized  correlation  function  C,„(x  ,y  ;P) 

o o 

monotonically  decreases  when  the  magnitude  of  the  displacement  vector 
is  increased.  The  derivatives  of  the  normalized  correlation  function  depend 
upon  image  structure  and  the  contrast  of  the  image  being  correlated.  The  slope 
of  the  normalized  correlation  function  also  determines  the  accuracy  of  parallax 
measurement.  By  determining  the  displacement  necessary  to  achieve 

a maximum  value  for  the  normalized  correlation  coefficient  it  is  possible  to 
determine  the  parallax  difference  associated  with  the  image  point  P. 

2.  3 Experimental  HOC  System 

The  experimental  HOC  System  was  designed  and  fabricated 
with  the  objective  of  determining  the  feasibility  of  the  heterodyne  optical  corre- 
lation concept.  The  optical  configuration  of  the  experimental  HOC  system 
is  shown  In  Figure  2.2 

I.ight  from  the  laser  (Spectra  Physics  Model  125-50  mw)  is 
directed  into  the  two  channels  of  the  Interferometer  with  the  50/50  dielectric 
beam  splitter.  A linear  wedge  neutral  density  filter  permits  attenuation  of  the 
laser  power  before  it  enters  the  interferometer.  Electronically  operated  shutters 
S and  S permit  selective  illumination  of  the  two  transparencies.  The  modulator 

X M 

M is  used  to  modulate  the  optical  path  difference  between  the  two  channels  of 
the  interferometer.  The  modulator  consists  of  a 5x5x1  mm  size  glass  plate 
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attached  to  the  spindle  of  a ririlvo.sonnner  (General  Scanning  G-100)  , The  oscillation 
of  the  glass  plate  in  the  path  of  the  iK'am  residls  in  the  time  modulation  of  the 
optical  path  difference  between  the  two  beams. 

The  illuminating  optics  in  each  channel  of  the  interferometer 

consists  of  a beam  divcrger  and  a condens*-r.  'nie  standrud  microscope  objective 

(20X)  and  a spatial  filter  placed  at  its  front  focal  jM)int  make  up  the  diverging 

optics.  The  comlenser  consists  of  a cond>inalii>n  i.>f  two  collimating  objectives 

mounted  back  to  back  so  as  to  minimize  wavefront  (iistortion.  The  objectives 

have  focal  lengths  of  220  and  MO  mm  ;uid  l*»»th  Ic  ises  have  clear  aperture  diameters 

of  50  mm.  The  two  transparencies  T ami  T are  mounted  on  translation 

1 Z 

stages  and  are  placed  as  close  to  the  condenser  optics  as  possible  so  as  to 
obtain  maximum  coverage  of  the  area  of  illumination  at  the  plane  of  transparency. 
The  circular  illumination  area  obtaine  1 in  the  experimental  HOG  h:is  a dia- 
meter of  approximately  40  mm. 

'rhe  final  imaging  lens  I.  (KI,  NIKKOH  Projection  Lens, 

ft) 

85mm/f2.  8)  produces  superimposed  images  of  the  transparencies  at  the  common 
image  plane  occupied  by  the  detector  array.  The  beam  splitter,  acting  as  a 
tilted  plane  parallel  glass  plate  introduces  astigmatic  aberration  in  the  imaging 
process.  However  since  the  beam  splitter  is  located  at  the  long  conjugate  side 
of  the  imaging  lens  (f  of  the  cone  of  rays  being  large),  the  aberration  Intro- 
duced is  negligible.  The  beam  splitter  is  formed  by  cementing  together 
two  identical  plane  parallel  glass  plates  with  the  beam  splitting  coating  at 
the  cemented  interface.  This  symmetric  nature  of  the  final  beam  splitter 
also  assures  that  the  aberrations  have  the  same  effect  on  both  Images.  Thus 
the  aberrations  produced  have  little  effect  on  the  correlation  value. 

The  d.c.  block  is  a circular  opaque  spot  (.25  mm  diameter) 
formed  with  India  Ink  on  a microscope  slide  and  Is  placed  at  the  point  of  convergence 
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of  the  illuinin  itintj  beam.  The  d.  e.  block  is  located  between  the  final  beam  splitter 
and  the  imuj*ing  lens  1.,^  and  hence  is  connnon  to  both  images.  Because  of  this 
fact  once  again  the  small  aberration  contril)ution  of  the  microscope  slide  has 
negligible  effect  on  the  correlation  value.  It  is  to  be  emphasized  here  that 
minimum  number  of  optical  components  have  been  introduced  between  the  trans- 
parencies and  the  final  imaging  lens.  This  simplicity  in  optical  configuration 
not  only  enhances  the  resolution  performance  of  the  final  imaging  optics  but 
also  reduces  significantly  geometric  distortions  during  imaging,  iience  it 
is  possible  to  maintain  the  geometric  fidelity  of  the  transparencies  during  the 
measurement  pi'oeess. 

The  final  beam  splitter  has  two  output  beam  paths  that  are 
normal  to  each  other.  One  of  the  beam  paths  as  described  earlier  is  directed 
to  the  array  detector.  I.ens  (EL  NIKKOR  Projected  Lens  85mm  f/2.  8),  placed 
symmetrical  to  lens  L„  in  the  path  of  the  other  beam  also  produces  superimposed 
images  of  the  transparencies  in  the  common  image  plane.  The  common  image 
is  examined  under  white  light  illumination  with  a lOOX  microscope  mounted  on 
a three  axis  stage.  The  visual  examination  of  the  common  image  plane  permits 
manual  relative  orientation  of  the  two  transparencies. 

The  mechanical  part  of  the  system  consists  of  the  various 
translation  stages  containing  the  transparencies,  the  array  camera  and  the 
microscope,  mechanical  mounts  for  lenses,  mirrors  and  beam  splitters  and 
the  overall  support  for  the  instrument.  In  this  section  no  detailed  description 
of  the  mechanical  mounts  is  provided  for  the  sal^e  of  briefness.  The  fundamen- 
tal requirement  of  the  mechanical  mounts  used  in  the  system  is  mechanical 
riglaity.  Each  transparency  is  mounted  in  the  plate  holder,  its  face  against 
a plane  steel  reference  surface  as  a reference  for  the  instrument.  The  holder 
is  mounted  on  a three-axis  translation  stage,  each  axis  being  controlled  inde- 
pendently by  a stepping  motor,  having  an  incremental  resolution  of  3. 175 


EIKONIX 


I 

I 

I 

I 

I 

I 


f 

I 

I 

I 

I 

I 

I 

I 


micrometers.  The  plate  holder  can  also  be  rotated  about  the  optical  axis  of 
the  system  (normal  to  its  plane)  with  a resolution  of  about  40  arc  secs.  During 
the  initial  mechanical  alignment  of  the  S3'Stem  the  steel  reference  surfaces 
are  made  parallel  to  within  a few  minutes  of  arc.  The  microscope  stages  and 
the  array’  camera  stages  are  mechanically  aligned  to  be  parallel  to  the  stages 
containing  the  transparencies  and  hence  reference  points  can  be  transferred 
easily  from  one  coordinate  system  to  the  other  provided  the  magnification 
between  stages  is  known  exactly  (as  discussed  later  in  this  report,  the  magni- 
fication can  be  measured  very  accurately).  The  stages  are  mounted  to  the 
main  frame  rigidly  to  provide  a high  degree  of  repeatability  and  stability. 

The  electronic  system  consists  of  the  detector  array  and  its 

interface  electronics,  the  shutter  controls,  the  stepping  motor  controls  and 

the  control  computer.  ITie  array  used  is  a 32x32  element  RETICON  array. 

The  array  is  interfaced  directly  to  the  control  computer  so  that  the  output  of 

each  element  can  be  read  sequentially.  The  saturation  exposure  for  the  array 
2 

is  3 p w/cm  sec.  The  sensitivity  of  the  detector  depends  upon  the  integration 
time  (time  to  scan  a complete  frame)  and  it  can  be  altered  by  altering  the  clock 
frequency.  The  smaller  the  clock  frequency  the  greater  is  the  sensitivity 
of  the  detector.  However  the  smaller  the  clock  frequency  depends  upon  the 
power  density  available  at  the  final  image  plane. 

In  the  present  HOC  system  a 200  KHz  clock  rate  was  used 

resulting  in  an  integration  time  of  5. 12  msec.  Power  density  for  saturation 

2 

was  approximately  0.6  mw/cm  . Because  of  the  large  power  He-Ne  laser  that 
was  used  in  the  e.xperimental  HOC,  it  was  necessarj’  to  lower  the  laser  power 
input  with  neutral  density  filters  to  achieve  a power  density  lower  than  the 
saturation  level.  In  the  case  of  the  experimental  HOC  the  clock  rate  was  optimized 
on  the  basis  of  the  Input/output  requirements  of  the  control  computer. 

'fhe  shutters  (VINCENT  ASSOC)  arc  operated  directly  by  the  control 
computer  and  have  a time  of  response  of  about  5 msecs.  Each  of  the  stepping 
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motors  associated  with  tl\e  six  stages  (tliree  for  each  of  the  transparencies) 
can  be  Independently  controlled  by  the  computer.  The  modulator's  Galvo- 
scanner  is  driven  by  an  independent  signal  source  and  is  not  controlled  by  the 
computer.  In  order  to  minimize  the  dynamic  range  and  nonlinear  problems 
associated  with  the  array  due  to  the  fourfold  increase  in  maximum  output,  when 
both  shutters  are  open,  a neutral  density  filter  operated  by  a solenoid  mechanism 
is  introduced  into  the  path  of  the  laser  beam  before  it  enters  the  interferometer. 

The  neutral  density  filter  is  inserted  only  when  both  shutters  are  open  and  its 
operation  is  also  controlled  by  the  control  computer.  The  control  computer 
used  is  a HP21MX  minicomputer  with  a 24K  memory. 

2. 4 Stereo  Compilation  Procedure 

This  procedure  refers  to  the  actual  measurement  of  x and  y 
parallaxes  between  conjugate  images  in  a stereopair  of  transparencies.  The 
measurement  procedure  of  the  experimental  HOC  can  be  considered  identical 
to  stcreocomparator  measurements  at  a two-dimensional  matrix  of  points 
defined  by  the  projections  of  the  detector  array.  Because  of  the  extreme  geo- 
metric fidelity  of  the  detector  array,  each  elemental  area  defines  a precise 
location  on  the  transparency. 

By  using  a grid  plate  for  initialization,  it  is  possible  to  relate 
precisely  the  coordinate  system  of  the  array  elements  to  that  of  the  photostages. 

The  procedure  for  compiling  a stereomodel  is  as  follows:  with  the  use  of  the 
microscope,  the  two  transparencies  representing  the  model  are  relatively 
oriented  and  the  x-parallax  direction  is  made  to  correspond  to  the  x-axis 
of  the  translational  stages.  Once  the  relative  orientation  of  the  stereo  trans- 
parencies In  the  instrument  has  been  achieved,  the  starting  point  for  the  compilation 
procedure  is  the  adjustment  of  the  movable  transparency  in  Channel  1 to  repre- 
sent conjugate  image  coincidence  in  a chosen  datum  plane  (to  assure  x and  y 
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axes  translation  alon^?  one  direction).  These  operations  have  been  accomplislied 
with  white  lij;hf,  hereafter  eohei'ent  linht  is  used. 

For  ani'  );iven  orientation  of  the  two  superimposed  images  the 
normalized  correlation  coefficient  is  determined  at  each  element  of  the  array.  To 
accomplish  this,  the  values  corresponding  to  Kciuation  f2.  10)  and  (2.  11)  are 
first  determined  for  individual  projectors,  by  measuring  the  intensity  distribution 
over  the  image  plane  due  to  each  projector  when  the  light  from  the  other  projector 
is  blocked.  The  modulated  intensity  value  defined  by  Equation  (2.  8)  is  then 
determined.  In  actuality  this  sequence  of  stei)s  is  automatically  carried  out 
by  the  control  computer.  First  with  shutter  in  Channel  1 closed,  the  output  of 
each  element  of  the  array  is  read  and  stor<*d  in  the  computer.  In  order  to 
Improve  the  signal  to  noise  ratio,  the  average  of  the  readings  of  several  frames  is 
made.  The  number  of  frames  to  be  averaged  (five  in  most  of  the  experiments 
performed  is  one  of  the  input  parameters  and  can  be  adjusted  to  be  any 
value  greater  than  zero.  The  number  of  frames  to  be  averaged  is  optimized 
against  the  required  speed  of  the  compilation  procedure.  Tlie  same  procedure 
is  repeated  with  the  shutter  in  Channel  1 closed.  Finally  the  modulated  intensity 
teiTn  is  determined  with  the  shutter  in  both  channels  open.  Due  to  the  inter- 
ference between  the  two  beams,  the  intensity  distribution  at  the  innge  plane  is 
time  modulated  at  the  frequency  determined  by  the  modulator  in  Channel  1 
of  the  interferometer.  During  this  measurement,  the  output  of  the  array  is 
read  sequentially  over  several  frames.  The  first  reading  is  stored  in  two  locations 
to  represent  the  minimum  Intensity  and  the  maximum  intensity  corresponding 
to  each  clement  of  the  array.  The  output  of  the  subsequent  frames  is 
compared  to  the  maximum  and  minimum  values  stored  for  the  corresponding 

element  and  the  resulting  maximum  and  minimum  values  are  stored.  After 

1 

a large  number  of  frames  compared  to  the  frequency  of  modulation 

has  been  read,  the  difference  between  the  stored  maximum  and  minimum  Intensity 
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Figure  2.  3 Correlation  Coefficient  Data  Matrix 
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values  pn)vides  the  amplitiide  defined  by  the  Kiiuation  G^.5)  for  each  element  of 
the  array.  The  increase  in  the  number  of  frames  read  decreases  the  uncertainity 
in  the  measurement  of  the  amplitude  of  modulated  intensity,  however  it  has  to 
be  optimized  against  the  speed  of  operation.  The  number  of  fringe  sampling 
frames  used  in  most  of  the  experiments  is  32  and  its  value  can  be  adjusted.  The 
number  of  frames  averaged  and  the  number  of  fringe  sample  fi'ames  are  a part 
of  the  input  parameters  to  the  contix)!  computer. 


The  computer  introduces  the  x-parallax  steps  in  incremental 
fashion  and  the  normalized  correlation  value  at  each  element  of  the  array  at 
each  step  is  determined  and  stored.  After  the  prescribed  number  of  x-parallax 
steps,  the  x-stage  returns  to  the  original  position.  Next  a y-parallax  step 
is  introduced.  The  stepping  in  x-parallax  is  repeated  for  the  new  y-parallax 
position.  The  procedure  is  repeated  for  the  prescribed  number  of  y-parallax 
positions.  The  total  number  of  steps  taken  is  given  by  n^  n^  where  n^ 
is  the  number  of  x-parallax  steps  and  n^  is  the  number  of  y-parallax  steps. 
The  resultant  data  can  lx;  represented  in  a three-dimensional  form  shown  in 
Figure  2.3.  It  is  clear  that  by  scanning  the  histogram  of  the  normalized 
correlation  values,  it  is  possible  to  determine,  for  any  given  element  on  the 
array,  at  what  x and  y step  the  image  matching  was  maximum.  Hence  x 
and  y step  values  at  which  image  matching  was  maximum  becomes  the  x 
and  y parallax  value  for  the  correlation  area  defined  by  that  element  on  the 
reference  transparency.  The  final  output  of  the  computer  is  then  two  2-D 
matrices  of  x and  y paralhix  values  representing  each  elemental  ar*ea 
defined  by  the  array  (Figure  2.4).  During  actual  measurement  the  three- 
dimensional  matrix  illustrated  in  BTgure  2,3  is  never  stored.  For  a given 
X and  y parallax  position,  the  output  of  the  measurement  sequence  provides 
three  parameters  for  each  clement  of  the  array.  They  are  the  x and  y 
parallax  steps  and  the  corresponding  normalized  correlation  coefficient. 
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The  value  of  the  normalized  correlation  coefficient  is  compared  with  the  previous 
stored  value  for  the  corresponding  array  element  and  only  the  parameters  corres- 
poinding  to  the  maximum  value  are  stored.  'I’hus  the  storage  requirement 
for  the  control  computer  is  greatly  reduced.  Tlie  storage  requirement  is 
determined  by  the  array  size  and  not  ljy  the  number  of  x and  y parallax 
steps  introduced. 

The  objective  of  the  experimental  HOC  tests  were  to  demonstrate 
the  feasibility  of  the  concept.  Hence  the  problem  of  measurement,  storage 
and  manipulation  of  the  data  was  simplified  by  restricting  the  measurement  to 
x-parallax  values.  However  the  y-parallax  steps  were  still  necessary  to  max- 
imize correlation  and  unambiguously  define  the  x-parallax  value  and  the  exact 
y-parallax  step  value  was  neither  tracked  nor  stored.  Since  most  of  the  aerial 
transparencies  used  during  the  tests  were  nearly  vertical,  the  y-parallax 
values  were  small  and  did  not  introduce  significant  errors.  Also  this  compromise 
in  measurement  reduced  the  need  for  additional  computer  memory. 

When  there  is  insufficient  image  structure  present  within  the 
correlation  area  of  either  of  the  transparencies,  the  image  intensity  measurement 
of  the  corresponding  detector  element  will  be  a minimum  due  to  the  presence 
of  the  d.  c.  block  in  front  of  the  imaging  lens.  Image  structure  is  necessary 
to  diffract  light  beyond  the  d.  c.  block  in  the  spatial  filter.  To  avoid  ambiguous 
correlation  due  to  noise,  in  such  cases,  a condition  on  the  minimum  value  for 
the  intensity  measurement  can  be  imposed.  Only  measurements  greater  than 
this  threshold  are  considered  for  further  computation  of  the  correlation 
coefficient  for  that  particular  element.  In  the  experimental  HOC  such  areas 
are  delineated  by  the  presence  of  zeros  in  the  final  output  for  the  parallax  values. 

2. 5 Summary 

In  this  chapter  a brief  introduction  to  the  concept  of  Heterodyne 
optical  correlation  has  been  presented  along  with  the  description  and  the  operation 
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of  the  experimental  HOC  system.  The  purpose  of  this  chapter  is  to  provide 
continuity  to  the  report  and  more  detailed  discussions  on  the  text  anrl  evaluation 
of  the  experimental  system  can  l)e  found  in  references  (2,3  ). 


EIKONIX 


3 PKOPaSKD  PROTOTYPE  SYSTEM  MODEL 

3. 1 Introduction 

The  experimental  HOC  System  described  earlier  was  designed 
and  fabricated  to  demonstrate  the  feasibility  of  the  HOC  concept  under  conditions 
of  real  world  aerial  Imagery.  During  its  design  no  considerations  were  made 
to  optimize  the  system  configuration  and  the  measurement  procedure.  Hence 
the  configuration  of  the  experimental  HOC  system  does  not  necessai'ily  represent 
the  optimum  configuration  for  a prototype  system.  The  prototype  system  model 
chosen  has  a definite  bearing  on  the  feasibility  and  applicability  of  the  prototype 
HOC  system  for  field  applications.  The  heterodyne  optical  correlation  system  is 
a generalized  optical  correlation  system  which  pennits  the  detection  of  coin- 
cidence of  conjugate  images  in  a superimposed  common  image  plane.  In  general 
the  HOC  system  is  a complex  optomechanical  and  optoelectronic  instrument. 

The  nature  ot  the  operating  conditions  and  requirements  determine  the  complexity 
and  the  interaction  between  the  various  subsystems.  Hence  in  reality  the  prototype 
HOC  system  model  shouUl  bo  developed  after  considering  the  effects  of  the  operating 
environment  on  performance.  In  this  study  a system  model  is  first  developed 
on  the  basis  of  first  order  evaluation  and  Interaction  of  system  requirements. 

The  feasibility  and  applicability  of  the  proposed  system  for  field  applications  is 
then  evaluated.  Finally  a design  of  potential  prototype  system  is  described 
along  with  its  tolerance  requirements.  In  this  chapter,  the  evolution  of  the  HOC 
system  model  is  presented  along  with  its  advantages  and  disadvantages.  The 
unique  characteristics  of  the  proposed  system  model  are  also  outlined. 

3.2  System  Requirements 

The  intended  application  of  the  HOC  system  is  for  a prototype 
van-mounted  stereomodel  digitizer  to  be  used  in  the  field.  The  requirements 
for  the  proposed  stereo  model  digitizer  are 
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(a)  the  instrument  should  be  capable  of  generating  digital  terrain 
model  automatically  and  output  the  data  onto  magnetic  tape. 

The  spatial  and  height  resolution  of  the  output  data  must  be 
such  as  to  meet  the  needs  of  an  off-line  orthoprinter, 

(b)  the  instrument  should  be  capable  of  handling  small  scale  metric 
quality  frame  photos  as  input.  The  applicability  of  the  instrument 
to  • Lher  formats  such  as  oblique  and  panoramic  inputs  should  be 
considered, 

(c)  the  accuracy  of  the  digital  terrain  model  measured  must  be  such 
that  90%  of  the  points  at  orthoscale  (1:12,000)  should  be  within 
l/30th  of  an  inch  of  the  measured  point, 

(d)  the  instrument  should  be  rugged  enough  to  withstand  on  and 
off  road  movements  in  a van  and  yet  simple  in  construction. 

Operator  skill  required  and  interaction  should  be  kept  to  a 
minimiun.  Finally  the  speed  of  operation  of  the  instrument  is  less 
significant  but  it  must  be  consistent  with  the  reduced  requirements 
on  accuracy  for  this  instrument. 

The  system  requirements  outlined  above  clearly  indicate  that 
if  the  HOC  system  were  to  be  applicable  it  must  be  capable  of  withstanding 
adverse  environmental  and  operating  conditions.  While  in  concept  the  HOC 
system  can  meet  the  performance  requirement  (a)  and  (c),  the  system  model 
chosen  will  determine  the  capability  with  regards  to  performance  requirement 
(b)  and  (d), 

3. 3 System  Model  Options 

There  are  several  options  available  for  HOC  system  configuration 
and  the  measurement  procedure.  The  HOC  system  can  be  configured  analogous 
to  a double  projection,  photogrammetrlc  plotting  Instrument  or  a stereo  comparator  - 


23 


EIKONIX 


I 


I 

I 

I 

I 


I 

I 


I 


I 

I 

I 

I 

I 

I 

I 

I 


analytical  plotter.  Also  (Icpeiitliiig  upon  the  input  photogoometry,  either  the 
entire  nuKlel  can  be  compiled  in  one  stage  or  the  model  caii  be  compiled  in 
small  sections. 

Following  an  earlier  investigation  of  the  performance  of 
the  experimental  HOC  system,  the  design  for  a follow-on  prototype  HOC  system 
configuration  was  described.  The  optical  configuration  of  the  proposed  system 
is  shown  in  Figure  3. 1.  The  salient  characteristics  of  the  proposed  system  are: 

(a)  a two-dimensional  detector  array  of  320x512  elements  covers  the  entire 
overlapping  areas  of  the  two  transparencies, 

(b)  the  total  translation  of  the  movable  transparency  is  limited  to 
the  maximum  anticipated  parallax  in  X and  Y directions, 

(c)  except  for  the  condensing  lenses  all  the  optical  components 
used  are  relatively  small  in  size.  This  characteristics  permits 
the  overall  system  to  be  small  and  compact  and  hence  rigid 
and  mechanically  stable, 

(d)  the  HOC  system  output  gives  the  x and  y parallax  distribution 
over  the  stationary  control  transparency  and  must  be  digitally^ 
converted  to  provide  the  digital  ten  ain  values, 

(e)  the  system  operates  on  the  entire  model  area  in  parallel, 
depending  on  array  and  computer  interface  electronics,  the 
system  is  capable  of  Increased  operational  speed. 

In  the  HOC  system  model,  by  opting  to  cover  the  entire  model 
area  in  one  step,  the  mechanical  problems  of  translation  of  the  transparencies 
have  been  greatly  minimized.  However  consider  the  following  data  handling 
problems.  In  order  to  compute  the  normalized  correlation  co-efficient  at 
every  element  on  the  detector  array  for  any  given  parallax  position,  the 


24 


EIKONIX 


EIKONIX 


number  of  data  points  to  he  stored  is  8x320x512  eight  bit  words.  That  represents 
over  10  megabits.  This  requirement  for  large  memory  along  with  problem  of 
data  handling  result  in  insurmountable  problems.  Thus  while,  the  instrument 
is  compact  and  simple  from  an  opto-mechanical  point  of  view  it  becomes 
vei7  complex  imd  slow  considering  digital  data  handling  and  data  management 
problems.  These  factors  coniplicate  the  concept  of  the  prototype  HOC  as  a comnact 
and  simple  stand  alone  instrument,  lliese  arguments  formed  the  basis  for  the 
rejection  of  this  system  model  for  the  HOC  prototype. 

Consider  now  the  model  in  which  only  a small  area  (2.  5 cm 
s(juare)  on  the  plane  of  the  transparency  is  illuminated  at  any  instant.  Hence  the 
large  condenser  lens  shown  in  Figure  3. 1 can  now  be  replaced  by  a one  inch 
diameter  collimator  lens.  The  illuminated  areas  on  the  plane  of  the  transparencies 
are  imaged  onto  a small  50x50  detector  array  instead  of  320x512  detector  array. 

The  two  transparencies  are  mounted  such  that  they  can  be  moved  together 
such  that  any  ix)rtlon  of  the  overlapped  area  behvecn  the  transparencies  can  be 
covered  by  the  illuminating  2.5  cm  square  aperture.  The  transparency  2 is  in 
turn  mounted  on  a small  stage  which  permits  only  small  relative  translation 
of  transparency  2 with  respect  to  transparency.  This  small  x and  y translation 
is  necessary  to  introduce  the  parallax  during  measurement. 

In  this  HOC  system  model  configuration  only  a small  area  is 
illuminated  at  any  given  time.  This  reduces  the  complexity  of  the  optics  used 
and  also  the  over  all  optical  length  can  be  made  small.  All  these  factors  permit 
the  optical  system  to  be  small,  compact  and  hence  highly  stable.  From  an 
electronic  data  processing  point  of  view,  at  any  given  instant  data  corresponding 
to  only  2500  points  are  being  manipulated  to  arrive  at  the  parallax  value  and 
hence  the  memory  and  processing  hardware  requirements  are  small.  It  is 
highly  probable  that  the  requirements  can  be  handled  by  microprocessor  based 
systems. 
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In  this  HOC  sysU;ni  model  tho  electronic  data  reduction  and 
handling  hardware  problems  have  been  overcome  at  the  expense  of  simplicity 
and  the  non-kinematic  aspects  of  large  mechanical  components.  Since  the  formats 
of  the  ti'ansparencles  to  be  handletl  by  the  sj'stemarc  large,  large  displacements 
ai'e  involved  in  moving  the  trimsparencics  over  the  illuminated  area  to  cover 
the  entire  stereo  model.  However  by  decoupling  the  parallax  measurement 
stage  from  that  of  the  image  scamiing  stage,  the  problem  of  obtaining  high 
precision  and  accuracy  of  displacement  over  fairly  large  distances  is  greatly 
reduced.  Any  errors  that  result  during  the  image  scan  motion  reflect  as 
registration  errors  between  different  blocks  of  points  compiled  independently 
and  they  do  not  reflect  in  the  accuracy  of  parallax  measurement.  Only  the 
second  translation  stage  (which  has  only  limited  travel)  has  to  be  very  accurate,  since 
its  displacements,  directly  represent  parallax.  Thus  by  proper  trade  off  between 
the  optical,  mechanical  and  electronic  subsystems  it  is  possible  to  configure 
an  HOC  system  that  meets  the  objective. 

From  a photogrammctric  data  reduction  j)oint  of  view,  there 
is  again  a trade  off  between  optical  system  complexitj’  and  electronic  data 
processing  hardware  requirements.  The  HOC  instrument  can  be  considered 
a double  projection  system  in  which  the  indindual  transparencies  can  be  re- 
latively oriented  to  provide  an  image  at  the  common  image  plane  that  is  corrected 
for  scale,  tilt  and  tip.  This  approach  minimizes  the  subsequent  photogrammctric 
manipulation  of  the  data  measured.  However  the  requironents  for  change  in 
scale,  tilt  and  tip  put  a great  demand  in  the  stability  and  flexibilit}’  of  optical 
and  mechanical  components. 

However  if  the  transparencies  were  mounted  such  that  they  are 
parallel  to  the  output  array  plane  then  the  data  extracted  from  the  HOC  becomes 
essentially  those  obtainable  from  a stereo  comparator.  This  is  because  of 
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the  fixed  relationship  between  the  reference  transparency  and  the  dctifctor  array 
and  the  definition  of  the  co-ordinates  of  the  conjugate  image  points  in  the  movable 
transparency  2 through  the  measured  x and  y parallax  data.  The  measured 
data  have  to  be  subsequently  processed  to  produce  the  object  space  co-ordinate 
iiiformation. 

By  adopting  the  small  detector  array  approach  the  on-line 
photogrammetric  processing  of  the  measured  data  to  produce  ground  positional 
information  becomes  feasible  and  attractive.  This  approach  to  HOC  measurement 
procedure  is  not  i/ithout  its  limitations.  iTiese  limitations  will  be  discussed 
in  detail  later  in  this  report. 

The  proposed  HOC  system  model  is  illustrated  in  Figure  5.  2, 

The  general  characteristics  of  the  proposed  sj^stem  are: 

(a)  The  illuminating  beam  diameters  at  the  plane  of  the 
transparency  is  1.5  inches.  A 50x50  detector  array  projected 
back  onto  the  transparency  covers  a square  inch  area. 

(b)  The  plane  of  the  transparencies  are  fixed  with  respect 
to  the  imaging  optics  and  the  detector  array  and  are 
projected  on  the  array  plane  at  nominally  the  same  scale. 

The  plane  of  the  transparencies  as  well  as  the  plane  of 
the  detector  array  are  perpendicular  to  the  optical  axis 
of  the  imaging  lens. 

(c)  A large  stage  on  which  the  two  transparencies  are  mounted 
ixjrmit  fhe  translation  of  the  two  transparencies  together 
to  cover  the  entire  stereo  model  area.  A small  stage 
mounted  on  top  of  the  large  stage  permits  translation  of 
transparc-ncy  2 with  respect  to  transparency  1 so  as  to 
Introduce  parallax  during  measurement,  llie  stages  are 
all  mounted  horizontally  to  assure  mechanical  stability  and 
speed  of  translation. 
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(dt  ln(Jo|H'n<lent  processing  hardware  permits  continuous 

processing  of  the  measured  data  in  50x50  blocks  to  obtain 
digital  terrain  data,  'lliis  factor  overcomes  the  need  for 
bulk  data  handling. 

Based  on  this  system  model  the  feasibility  of  the  HOC  system 
as  a van  mounted  stereomodel  digitizer  is  evaluated  in  the  following  pages 
of  this  report. 
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4 HOC  SYSTKM  KVALUATION 

1. 1 Introduction 

In  order  to  assess  the  feasibility  and  applicability  of  the  HOC 
system  for  field  applications,  the  tolerance  specifications  of  the  optical,  mech- 
anical and  electronic  subsystems  as  a function  of  the  required  performance 
characteristics  of  the  system  must  be  evaluated.  In  this  chapter  the  character- 
istics and  tolerances  of  the  various  components  and  subsystems  that  form  the 
poUmtial  HOC  system  are  evaluated  from  the  point  of  view  of  fabrication  and 
maintenance. 

1.2  Effects  of  Vibration  on  Correlation  Co-Efficient  Measurements 

The  measurement  of  the  normalized  correlation  co-efficient 
C fonns  the  basis  for  detecting  conjugate  image  coincidence  in  a HOC  system 
and  hence  any  errors  in  its  measurement  directly  affects  the  accuracy  and 
precision  of  the  x and  y parallax  measurements.  One  of  the  major  environ- 
mental factors  that  is  important  from  the  point  of  view  of  correlation  co- 
efficiimt  measurement  is  mechanical  vibration  of  the  optical  system.  Vibration 
problems  associated  with  optical  systems  have  always  been  a source  of  concern 
and  the  HOC  system  being  an  interferometer  is  highly  susceptible.  There  are 
basically  two  approaches  to  overcome  the  vibration  problems.  First  the  instru- 
ment can  be  made  extremely  rigid  mechanically  but  such  an  approach  would 
make  the  over  all  optical  subsystem  hea\'y,  large  and  cumbersome.  The 
sc-cond  approach  is  to  make  the  measurement  process  relatively  insensitive  to 
typical  mechanical  vibration  likely  to  be  encountered  in  a field  application. 

In  the  experimental  HOC,  during  the  correlation  co-efneient 
measurement,  the  values  corresponding  to  equations  (2. 10)  and  (2. 11)  are 
first  determined  for  Individual  projectors  by  measuring  the  intensity  distribution 
over  the  Image  plane  due  to  each  projector  when  the  light  from  the  other  projector 
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is  blocked.  During  this  measurement  process  mechanical  displacements  due 
to  typical  vibration  do  not  cause  any  problems.  After  these  measurements  the 
modulated  intensity  value  defined  by  equation  (2.  9)  is  then  determined.  During 
this  measurement  the  array  is  read  sequentially  over  several  frames.  Due 
to  the  interference  between  the  two  beams,  the  intensity  distribution  at  the 
output  image  plane  is  time  modulated  at  the  frequency  determined  by  the  modulator 
in  chiuinel  I of  the  interferometer.  The  scanned  data  from  the  array  is  searched 
to  determine  the  maximum  and  minimum  values  at  each  element  of  the  detector 
array.  The  peak  to  peak  value  of  the  intensity  fluctuation  can  then  be  used  to  define 
the  amplitude  given  by  equation  (2.9).  The  increase  in  the  number  of  frames 
scanned  decreases  the  uncertainty  in  the  measurement  of  the  amplitude  defined 
by  equation  (2,  9)  and  hence  reduces  the  uncertainty  in  the  measurement  of  the 
normalized  correlation  co-efficient.  Since  this  measurement  process  occurs 
over  nearly  one  to  two  seconds,  any  modulation  of  the  fringe  pattern  due  to 
vibration  interferes  with  the  measurement  process.  Hence  the  experimental 
HOC  measurement  approach  used  as  such  would  represent  an  operational 
draw-back. 

However  modifications  to  the  measurement  approach  are  feasible 
that  permit  one  to  over  come  these  problems.  Consider  the  following  measurement 
process  in  which  four  measurements  of  the  intensity  distribution  at  the  common 
image  plane  is  made  using  the  detector  array. 

Measurement  1(1^):  Array  reading  with  one  channel  of  the 

interferometer  closed  (channel  2) 

Measurement  2(1  ):  Array  reading  with  both  channels  of  the 

A 

interferometer  open 

Measurement  3(1  );  Array  reading  with  both  channels  open 

•5 

and  one  channel  phase  shifted  by  90 
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Measurement  Array  reading  with  both  channels  open  and 

one  channel  phase  shifted  by  an  additional  90° 

Stored  Value  (I  ):  The  dark  current  measured  with  both  channels 

o 

closed  at  the  start  of  the  measurement  procedure, 
transparency  1 in  channel  1:  t^(x, y) 

transparency  2 in  channel  2;  t (x, y) 


A is  the  projected  area  of  the  individual  detector  at  the  plane  of  the  transparency, 

I = Dark  Current 
o 


I.  = I dA  + dark  current 


I = / CdA  + I 

1 ; 1 


^2  = 


t„dA  - 2sinkA/t,CdA  ^ I 
2 / 1 2 o 


dA  - 2 cos  kA  / t t dA  + I 

/ X O 


.jlloA  •/  tg  dA  + 2 cos  kA  / ^^2^^  ^o 

=y*  tjdA  ^ J t^dA  - 2sinkAy^tj^ 

■4  =/‘i“  + J t^dA  - 2 cos  kA  t 

/t%A  = I - I 
1 1 o 

JtjdA 


t^dA  = 


^2  ^ '4 


*2  " '4 


(4.1) 


(4.2) 


(4.3) 


(4.4) 


(4.5) 


(4.6) 
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2 sinkA  / t,  t_  dA  = 

[^2  ^ ^4 

- I 

I - I 

/ 1 2 

2 

o 

3 o 

2 ^3  • 


2 cos  I;A 


A 


t2dA 


= 1/4 


« [(I; 


= 1/10  I(l2  + l4-2l/  + a^-l/ 


The  correlation  coefficient  C 


is  given  by 


= 1/lG 


for  the  purpose  of  detcnnining  the  location  of  image  co-incidence 
is  as  good  as 


C 


12 


2 


(4.7) 

(4.8) 

(4.9) 


(4.10) 
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In  this  nieasiTcinenl  process  the  intensity  distribution  at  the 
image  plane  can  be  stable  during  the  four  measurements  with  the  detector  array. 
With  a SOxHO  detector  array  operating  at  a clock  frequency  of  400  KHz,  the  time 
rc(iuired  to  nuikc  the  measurement  is  about  25  msecs.  Most  of  the  mechanical 
vibrations  are  about  10-15  Hz  and  hence  for  all  practical  purposes  the  intensity 
distribution  is  stable  during  the  measurement  process. 

Experiments  were  performed  with  the  experimental  HOC  at  the 
Center  for  Coherent  Optics,  USAETL,  to  prove  the  feasibility  of  the  new  measure- 
ment proeeso.  The  comparison  of  the  correlation  values  measured  using  the  new 
measurement  approach  and  the  old  approach  proved  the  feasibility  and  indicated  that 
the  measurement  speed  is  limited  by  the  computer  rather  than  by  system  inertia. 
The  new  measurement  approach  not  only  makes  feasible  the  application  of  the 
HOC  instrument  under  reasonably  hostile  vibration  environment,  but,  as  discussed 
later,  represents  a significant  improvement  in  the  evolutionary  development 
of  the  HOC  prototype  system. 

4.3  Effects  of  Mechanical  and  Thermal  Drifts  or  Normalized 

Correlation  Coefficient  Measurement 

The  determining  of  the  optical  system  and  the  interferometer 
is  a realistic  possibility  in  the  application  HOC  type  instrument  in  a field 
environment.  The  stability  of  optical  alignment  is  of  concern  in  four  sections 
of  the  HOC  optical  configuration.  They  are  (1)  Beam  expanding  optics,  (2)  Con- 
densing optical  system,  (.3)  Imaging  optics  and  (4)  the  Interferometer. 

The  stability  problems  associated  with  the  first  three  are  less 
significant  while  the  stability  problems  of  the  interferometer  has  direct  consequence 
on  the  measurement  process.  Tlie  effect  of  stability  (both  laser  beam  and  optics) 
on  the  beam  expanding  optics  is  to  destroy  the  uniform  illumination  across  the 
beam  diameter.  This  problem  as  it  applies  to  the  HOC  system  can  be  overcome 
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by  proper  design  of  the  beam  expanding  opties.  I'’or  example  by  making  the 
spatial  filter  pinhole  to  be  of  slightly  larger  diameter  than  the  diffraetion  limited 
spot,  the  sensitivity  of  the  beam  expanding  optics  to  stability  problems  can  lx; 
reduced. 

'fhe  concern  for  the  condensing  optics  stability  is  caused  by 
the  requirement  of  the  relative  alignment  between  the  d.c.  block  in  front  of 
the  imaging  optics  and  the  optical  ;ixis  of  the  condenser.  J5y  making  the  size 
of  the  d.c.  block  slightly  larger  than  the  diffraction  limited  spot  size  of  the 
condenser  lens,  the  critical  alignment  requirement  can  be  reduced.  The  d.c. 
block  can  not  lx;  made  excessively  large  since  that  would  not  only  reduce  the 
power  at  the  common  image  plane  but  also  remove  the  low  spatial  frequency 
information  from  the  transparencies.  However  by  proper  choice  of  the  focal 
length  of  the  condensing  optics  and  the  size  of  the  d.c.  block  this  problem  can 
be  overcome. 

The  stability  of  the  imaging  optics  deals  directly  with  the  re- 
gistration of  the  array  with  respect  to  the  coordinate  system  of  the  transparencies. 
Anticipated  drift  problems  would  cause  only  very  minor  error  in  registration 
and  even  some  of  these  errors  can  be  reduced  by  subsequent  processing  of  the 
final  digital  terrain  model  data. 

Any  misalignment  of  the  interferometer  dvic  to  thermal 
or  mechanical  drifts  alters  the  shape  and  spacing  of  the  interferometric  fringes 
produced  in  the  final  image  plane.  According  to  the  conditions  defined  by  equation 
(2.  8),  the  optical  path  difference  between  the  interfering  beams  over  the  in- 
dividual detector  element  is  essentially  a constant.  The  thermal  and  mechanical 
instabilities  invalidate  this  assumption  that  A^(x,  y)  is  a constant  over  the 
aperture  A of  the  detector  clement.  However  if  the  aperture  diameter 
of  the  detector  A is  still  small  compared  to  the  fringe  spacing,  then  the  path 
difference  distribution  can  be  written  as 
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A^(x,y)  ^ * <5(x,y) 

where  A is  a constant  over  A representinK  the  average  value  and  6(x,v) 
o 

is  the  variation  about  A . \Vlien  the  width  of  the  detector  is  small  compared 

o 

to  the  friti;;e  spaeinji  6(.x,y)  is  small.  Equation  (^.8)  now  becomes 


S^(P,t)  = 2K^^tj(x,y)t^(x  + x^,y+y^)cos^^(A^  t 6(x,y)  f Vt)dA 

cos-^(A^  4 Vt  + 6(x,y))  = cos-^  (A^  + Vt)cos-^6(x,y) 

2ir  2ir  ^ 

- sin-T— (A  t Vt)sin— 7-  6(x,y) 

A O A 


(4.11) 


277 

cos  — ^(A  4 

A 0 

Vt) 

^ 6(x, 

1 

2 ■ 

. 2 77 

-sin-y- 

E Vt) 

277 

• ~T 

6(x.  y) 


neglectinjf  liigher  order  terms. 


Equation  then  beicomes 


Sy(P,t)  = 2Kcos 


277 


(A  + Vt) 
o 


dA 


277 

X 


Kcos— ;^(A 
A o 


(X,  y)dA 


477 

A 


6 (X,  y)dA 


(4. 12) 


The  above  expression  shows  that  the  effects  of  interferometer  misalignment 
is  to  lower  the  value  Sy(P,  t)  and  hence  the  value  of  As  long  as  the  value 
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of  6(x,y)  is  small  the  reduction  in  the  value  of  C has  no  sifinificant  impact 

1 ^ 

in  the  measurement  process  since  only  the  relative  value  of  C is  important. 

To  obtain  a qualitative  idea  of  the  tolerances  involved  consider  the  following 
numerical  example. 


Total  area  of  the  image  covered  on  the  plane  of  the  transparency  is  one 

square  inch  and  the  size  of  the  array  used  is  50  x 50.  It  can  be  shown  that 

the  assumption  27T  is  small,  is  valid  when  ever  the  detector  aperture 

X 


is  about  1/5  th  the  period  of  the  fringe  pattern.  Hence  there  can  be  as 
many  as  10  fringes  within  the  image  area. 


The  angular  tilt  of  the  plane  wave 


= 10  X X/2  ( X ~ . 6 microns) 

25  mm 

= .012  radians 
= . 7 degrees  or  42  minutes. 


This  angle  is  large  for  an  optical  system.  This  calculation  not  only 
shows  that  the  system  is  not  as  sensitive  to  mechanical  and  thermal  drifts 
as  a conventional  optical  interferometer  but  also  the  wedge  angles  associated 
with  the  film  substrates  will  have  minimal  effect  on  the  measurement  process 
as  long  as  they  are  of  reasonable  quality.  (For  example  ordinary  plate  window 
glass  has  the  tolerance  of  1-2  fringes/inch  variation  on  the  wedge  angle.) 

4.4  Tolerance  Requirements  of  Translation  Stages  and  their  Effect 
on  Measurement  accuracy 

In  the  proposed  HOC  system  the  option  of  mechanical  translation 
of  the  tnuisparencies  over  the  illuminated  aperture  of  the  interferometer  was 
selected  to  minimize  the  data  reduction  and  data  handling  hardware  problems. 
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Earlier  in  Chapter  .‘t  it  was  stated  that  by  decouplin}>'  the  parallax  stage  and  the 
image  scanning  stage,  the  problems  of  obtaining  high  precision  and  accuracy 
of  displacement  over  large  distances  is  greatly  reduced.  In  this  section 
detailed  explanation  is  presented  to  show  that  the  tolerance  requirements 
on  the  translation  stages  are  not  severe.  The  rcquii’emcnts  for  precision  and 
accurate  translation  stages  would  be  a disadvantage  for  HOC  as  a field  instrument, 
since  such  stages  require  continuous  care  and  maintenance. 

Idle  tolerance  requirements  for  the  translation  stages  can 
be  illustrated  by  considering  th^  operation  of  the  HOC  system  with  9"  frame 
inputs.  Typical  correlation  area  on  the  plane  of  the  transparency  is  500x500 
micrometers  and  aence  a 50.x50  detector  array  covers  a 1x1  inch  square  on 
the  transparency.  During  the  parallax  measurement  phase,  the  movable  trans- 
parency is  translated  with  respect  to  stationary  reference  transparency  in 
both  X and  y directions.  The  maximum  translation  requirement  of  the 
parallax  stage  in  both  .x  and  y directions  is  approximately  an  inch.  The 
accuracy  and  precision  of  the  magnitude  of  the  parallax  measured  is  entirely 
determined  by  the  parallax  stage.  It  is  comparatively  easy  to  obtain  high 
accuracy  and  precision  (of  the  order  of  a micron)  in  stages  that  have  a total 
translation  of  an  inch.  Typically  there  may  be  50  square  inches  in  a square 
model  and  hence  the  large  translation  stage  permits  simultaneous  displacement 
of  the  two  transparencies  and  the  parallax  to  permit  measurement  in  the  adjacent 
square  inch  area.  The  total  translation  requirements  for  the  large  x-y  stage 
is  typically  250  mms  in  both  directions.  Any  errors  in  translation  introduces 
an  error  in  the  registration  of  the  detector  array  with  respect  to  the  photo 
co-ordinates  of  the  stationary  reference  transparency.  Hence  this  error 
relates  not  to  the  measurement  of  parallax  but  to  the  definition  of  x-y  location 
on  the  transparency  at  which  the  parallax  has  been  measured.  The  measured 
parallax  in  all  automated  stereo  compilation  instruments  represents  an  average 
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over  the  correlation  area  which  in  this  case  is  500x500  micrometers.  Hence 
errors  of  the  order  of  25  mici-ometers  in  the  definition  of  the  center  of  the  correlation 
areas  will  have  an  insisnificant  effect  on  the  accuracy  of  the  computed  digital 
terrain  model.  Translation  stages  having  a precision  and  accuracy  of  the  order 
of  25  micrometers  over  a translation  distance  of  250  mm  are  common  and 
represent  off  the  shelf  technology.  However  if  the  two  transparencies  were  to 
be  mounted  independently  on  two  stages,  the  translation  errors  would  reflect 
directly  on  the  measurement  of  parallax,  necessitating  the  need  for  high  precision 
and  expensive  translation  stage  systems. 

'Hie  errors  in  the  image  scanning  translation  stages  can  be 
thought  of  as  slope  errors  and  therefore  their  contribution  to  the  final  data  can  be  considerably 
reduced  by  post  measurement  data  smoothing  and  data  processing.  Also  by 
overlapping  adjacent  blocks  of  data,  large  translation  errors  due  to  system 
drop  out  can  be  detected  and  the  continuity  of  the  measured  data  assured.  The 
above  di.'-cussions  clearly  indicate  that  the  requirement  for  mechanical  scanning 
of  the  input  transparencies  does  not  pose  serious  Impediments  to  the  application 
of  HOC  systems  in  the  field. 

4j5  Evaluation  of  Array  Detector  Sensitivity  and  I.aser 

Power  Reciuiremcnts 

The  basic  concept  of  the  HOC  system  requires  that  the 
two  superimposed  light  distributions  at  the  final  imago  plane  be  coherent  with 
each  other.  Laser  provides  a means  of  obtaining  high  intensity  monochromatic 
illumination  that  can  be  efficiently  coupled  into  the  interferometer.  Tlie  type 
of  laser  that  needs  to  be  used  in  the  prototype  HOC  system  is  a significant 
factor  that  has  Impact  on  the  feasibility  and  applicability  of  the  system  in  field 
appllv-atlons.  'The  requirement  for  a large  power  water  cooled  Argon  Ion  laser 
would  significantly  reduce  the  feasibility  of  the  concept  of  a rugged  ami  compact 
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HOC  system.  In  tins  sec  tion  the  factors  that  determine  the  laser  power 
rec|Uirements  are  outlined  and  calculations  arc  presented  to  show  that  a small 
and  simple  IIc-Nc  laser  would  meet  the  illumination  requirement. 

The  detector  arrays  are  integration  device.s  and  hence  their 
sensitivity  depends  on  the  speed  of  operation,  Wliile  large  integration  times  are 
preferred  from  the  point  of  view  of  low  laser  power,  the  measurements  have  to 
be  fast  enough  to  make  the  instrument  insensitive  to  vibration.  As  pointed  out 
earlier  in  Section  4, 1 the  clock  frequency  for  the  detector  array  must  be 
around  400  KHz  in  order  to  make  the  system  insensitive  to  most  of  the  mechanical 
and  building  vibration.  The  exposure  requirements  for  the  detector  array  can 
be  calculated  as  follows: 


The  saturation  exposure  for  the  array: 
Integration  time  at  400  KHz: 

The  saturation  power  tiensity: 

TOTAL  illuminated  area: 

TOTAL  power  required: 

Assume  an  optical  coupling  efficiency  of  20Vu. 

TOTAL  diffracted  power: 


, 3 watt  sec/cm 

G.  25  msecs 

.50  pwatts/cm^ 

2 

6.  25  cm 
. 3 m watts. 


1.  5 m watts 


Assuming  5%  diffraction  efficiency  for  the  structure  information  on  the  trans- 
parencies, total  laser  power  required  is  30  mwatts.  This  power  can  still  be 
further  reciuced  by  lowering  the  clock  frequency  if  necessary.  He-Ne  lasers 
capable  of  providing  30  to  40  mwatts  of  ouput  are  typically  3 to  4 feet  in  length 
and  they  do  not  require  special  power  or  water  cooling  provisions.  Such  lasers 
are  now  becoiu.ng  a common  OEM  item  in  computer  output  laser  printers  and 
hence  they  represent  reliable  and  field  proven  components  for  the  final  sj'stem. 


40 


EIKONIX 


‘I . (5  Kvaluation  of  the  Kffect  of  Input  "i'ranb’partmcy  Format  Cfometry 

on  the  l\‘rformanco  of  the  HOC  Sy.stcm 

Conju};ale  imase  matching  is  a basic  element  of  all  stero- 
photo^rammetric  operations.  Manual  methods  of  sterocompilation  rely  on 
steroscopie  perception  and  acuity  of  the  human  operator  to  achieve  conjugate 
image  matching.  In  automated  stereo-compilation  instruments  the  conjugate 
image  coincidence  is  detected  using  image  correlation.  Image  correlation 
involves  the  examination  of  the  similarity  of  the  image  structure  being  super- 
imposed to  ascertain  whether  they  are  conjugate  images.  Slope  and  perspective 
distortions,  difference  in  scale  between  transparencies  and  other  geometrical 
distortions  in  the  transparencies  cause  dissimilarity  between  conjugate  images. 

This  results  in  reduced  signal  to  noise  of  conjugate  image  coincidence  detection. 

In  some  of  the  electronic  correlation  systems  by  shaping  the  scan  process,  the 
problems  of  dissimilarity  can  be  overcome.  It  is  possible  to  introduce  con- 
tinuously variable  anamorphic  and  spherical  zoom  optics  in  both  channels  of  the 
IlfX'  interferometer  to  overcome  distortion  between  conjugate  images.  In 
fact  in  the  Gestalt  photomapper,  the  scanning  raster  is  shaped  over  a 50x50 
matrix  of  correlation  errors  and  such  a shaping  can  be  implemented  in  the 
HOC'  system.  However  from  a practical  viewpoint  such  additions  to  the  basic 
HOC  configuration  make  the  over  all  optomechjuiical  systems  too  complex  and  the  control 
problem  cumbersome.  Inability  of  HOC  type  optical  system  to  continually 
adopt  to  th(!  changing  input  format  geometries  is  a compromise  that  must  be 
made.  VVliile  it  is  theoretically  possible  to  design  optical  systems  to  provide 
nonlinear  distortion  corrections,  such  systems  are  not  yet  practical  in  the  field 
environment.  In  this  section  the  ability  of  the  HOC  system  to  utilize  unrectified 
convergent  Input  transparencies'  for  compilation  is  evaluated. 

Convergent  photography  consists  of  two  oblique  photographs 
taken  with  two  cameras,  with  one  tilted  forward  along  the  flight  direction 
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and  the  other  tilted  backward.  ConvcrRcnl  photography  enables  a large 
base  to  height  ratio  to  be  obtained  and  yet  achieve  100  percent  end  lap. 

Since  the  convergent  photographs  are  simply  low  oblique  photographs,  they 
can  be  analyzed  as  any  tilted  photos  to  determine  scale,  relief  displacement, 
tilt  displacement,  ground  point  coordinates  etc.  In  order  to  ev’aluate  the 
feasibility  of  HOC  concept  to  convergent  pairs,  the  parameter  tlrat  is  of  impor- 
tance is  the  rate  of  change  of  scale  accross  the  transparency. 

Consider  the  geometry  of  the  tilted  photograph  illustrated  in 
Figure  (4.  1).  Tilt  is  considered  here  to  be  the  single  resultant  tilt  that  is  a 
vector  addition  of  the  components  usually  referred  to  as  tip  and  tilt.  In 
convergent  photography  the  tilt  direct  is  also  the  flight  direction.  Wliile  the 
scale  of  the  photography  changes  along  the  direction  of  tilt,  the  scale  does 
not  change  along  any  line  that  is  perpendicular  to  the  direction  of  the  tilt. 
However  between  the  transparencies,  the  scale  is  approximately  equal  along 
only  one  lino  that  is  {Kirpendicular  to  the  direction  of  tilt  and  is  different 
everywhere  else. 

In  order  to  utilize  the  two  dimensional  cross  correlation  of 
conjugate  images  to  detect  their  coincidence,  it  is  essential  that  the  conjugate 
images  are  similar  in  scale  along  both  x and  y directions.  Since  the 
change  in  scale  between  conjugate  images  in  the  two  transparencies  is  in 
the  opposite  directions  of  the  nominal  value,  the  dissimilarity  between  the 
conjugate  images  would  drastically  reduce  the  detectability  of  the  point  of 
coincidence.  While  it  is  difficult  to  derive  the  exact  relationship  between 
difference  in  scale  and  the  broadening  effect  on  the  correlation  function,  based 
on  empirical  evidence  it  can  be  stated  that  difference  in  scale  between  conjugate 
images  should  be  less  than  10%. 

Using  the  notation  and  the  mathematics  outline  in  Reference 
(4  ),  the  scale  of  any  image  on  a tilted  photograph  can  be  expressed  as 
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s 


^-y  Sitv  t 
H - h 


where  t is  the  tilt,  y is  the  distance  of  the  image  from  the  isocenter  measured 
in  the  direction  of  the  tilt,  f is  the  focal  length,  H is  the  flying  height  and 
h is  the  height  of  object  point.  Let  us  consider  an  example  of  convergent 
photography.  Ideally, 


tan  t 


B 

2H 


Assuming  B/H  ^ 1, 

tan  t = . 5 
t = 25.5° 
sin  t = .447. 


At  the  isoccnter 


S 

o 


J 

H - h 


At  the  extreme  point  in  the  format 


H - h 


Change  in  scale 


.447  V 
H - h 
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The  difference  between  two  conjugate  Images  is  given  by 


AS 

P 


2 X (.  447)  V 
H - h 


~ y 

H-h* 

Percentage  change  in  scale 


If  the  tolerance  on  the  scale  between  conjugate  images  has  to  be  met,  the  area 
on  the  transparency  bounded  by  the  half  field  angle  is  approximately  6*^. 

This  is  too  small  an  area  and  the  discussion  presented  above  clearly  indicates 
that  it  is  not  feasible  to  directly  use  the  unrectified  convergent  photography 
in  a HOC  system. 

The  discussions  presented  above  do  not  apply  to  the  case  of 
panoramic  photography.  A panoramic  photograph  is  a picture  of  a strip  of 
terrain  taken  transverse  to  the  direction  of  flight.  The  geometry  of  the  panoramic 
photograph  is  shown  in  Figure  (4. 2),  along  with  an  illustration  of  the  stereo- 
scopic overlap  between  a pair  of  vertical  panormic  photos.  Using  the  parameters 
defined  in  Figure  (4, 2)  it  can  be  shown  that  (5),  the  scale  at  any  point  of 
a vertical  panoramic  phase  is 


Figure  4.2  Panoramic  Photo  Geometry 
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Where  f is  the  foeul  length,  4 scan  angle, 

h is  the  elevation  of  the  object  point  above  datum, 
y direction  is  given  by 


II  is  the  flying  height  and 
Also  the  scale  along  the 


S = S cos  4 
y X ^ 


(see  Reference  5 ) 


The  scale  of  the  imagery  within  a photo  varies  continuouslj'  from  point  to  point. 

Let  us  consider  the  scale  of  the  conjugate  images  in  a stereo-pair.  As  illustrated 
in  Figure  (4.2),  the  conjugate  image  lies  on  an  x strip  of  the  conjugate  images 
or  very  nearly  the  same  scan  angle.  Hence  the  scale  of  the  conjugate  images 
in  both  X and  y directions  have  to  be  nearly  the  same.  It  is  the  difference 
in  scale  between  conjugate  images  that  is  important  from  the  point  of  view  of 
operation  of  the  HOC.  The  geometrical  distortion  of  the  panoramic  stereo 
pair  represents  no  hindrance  to  the  applicability  of  the  HOC  concept.  The 
feasibility  of  the  HOC  instrument  to  accomodate  panoramic  input  transparencies 
depends  only  on  the  complexity  of  the  post  detection  data  processing  requirements. 

4.7  Summary 

In  this  chapter  the  feasibility  and  applicability  of  the  HOC 
system  for  field  applications  has  been  evaluated  by  considerang  the  tolerance 
specifications  of  the  optical,  mechanical  and  electronic  subsystems  as  a function 
of  the  performance  requirements.  The  analysis  presented  show  that  the  HOC 
system  can  be  configured  to  be  less  sensitive  to  vibration,  thermal  and  mechanical 
drifts  and  other  instabilities  inherent  in  the  field  environment. 
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5 PROPOSED  PROTOTYPE  HOC  SYSl'EM  DESIGN 

5. 1 Introduction 

The  discussions  presented  in  Chapter  4 clearly  indicate  that 
the  HOC  system  is  a potential  candidate  for  a van  mounted  stereo  model 
digitizer.  In  this  chapter  a conceptual  design  of  a prototype  HOC  system  is 
presented.  The  unique  characteristics  of  such  a system  are  outlined 
and  its  advantj^es  over  other  automated  electronic  stereo-compilation  systems 
are  described.  Some  of  the  hardware  design  details  are  presented  to  emphasize 
the  feasibility  and  availability  of  the  various  system  components.  The 
prototype  HOC  system  can  be  subdivided  into  optical,  mechanical,  and 
electronic  subsystems.  In  this  chapter  each  of  these  subsystems  are 
described  independently. 

5. 2 System  Description 

5.2. 1 Optical  System 

The  optical  configuration  of  the  proposed  prototype  HOC  system 

is  illiLstrated  in  Figure  5. 1,  and  the  actual  layout  is  shown  in  Figure  5.2.  Light 

from  a HeNe  laser  is  directed  into  the  two  channels  of  the  interferometer 

with  the  50/50  dielectric  beam  splitter.  Electronically  operated  shutter  S, 

pennits  selective  illumination  of  one  of  the  transparencies.  The  modulator 

M is  used  to  shift  the  optical  path  difference  between  the  two  channels  of  the 

interferometer.  The  illuminating  optics  in  each  channel  of  the  interferometer 

consist  of  a beam  dlverger  and  a condenser  lens.  The  folding  mirrors 

permit  the  transparencies  T and  T as  well  as  the  translation  stages  on  which 

X M 

they  are  mounted  to  be  horizontal.  The  horizontal  mounting  of  the  stages 
and  the  transparencies  assure  mechanical  stability  and  speed  of  translation. 

The  condenser  lens  is  mounted  behind  the  transparencies  as  close  as  possible 
so  that  the  diameter  of  the  condensing  optics  need  not  be  much  larger  than 
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Figure  5, 1 Optical  Configuration  of  HOC  Prototype  System 
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the  area  being  illuminated.  The  final  imaging  lens,  which  is  a part  of  the 
detector  array  camei'a.  produces  superimposed  images  of  the  transparencies 
at  the  common  image  plane  occupied  by  the  detector  array.  The  d-c  block  is 
located  between  the  final  beam  splitter  and  imaging  lens.  The  final  beam 
splitter  has  two  output  beams  that  are  normal  to  each  other.  One  of  the  beam 
paths,  as  described  earlier,  is  directed  to  the  array  camera.  The  other  is 
directed  to  a Vidicon  camera-closed  circuit  TV  system  so  as  to  permit  the 
examination  and  display  of  the  superimposed  images  of  the  transparencies. 

The  display  of  the  common  image  plane  permits  the  initial  manual  relative 
orientation  of  the  transparencies.  It  is  to  be  emphasized  here  that 
the  optics  used  are  neither  complex  nor  high  precision  and  most  of  the  components 
are  comparatively  small  in  size.  The  base  plate  shown  in  Figure  5.  2 is  expected 
to  be  approximately  5 feet  by  3 feet  in  size  and  that  provides  an  idea  of  the  over- 
all size  of  the  instrument. 

5.2.2  Mechanical  System 

The  mechimical  part  of  the  system  consists  of  the  translation 
stages,  the  transparency  holder,  the  mechanical  mount‘d  .•  the  optics  and  the 
overall  support  for  the  Instrument.  For  the  salce  of  brevity  only  the  design 
aspects  of  the  translation  stages  and  the  transparency  holders  are  discussed 
in  detail  in  this  section.  The  basic  design  characteristics  of  the  mechanical 
mounts  for  the  optical  components  and  the  overall  instrument  support  must  be 
mechanically  rigid.  By  proper  mechanical  design  many  of  the  component  mounts 
can  be  made  non-kinematic,  thereby  alleviating  some  of  the  alignment  drift 
problems. 

The  conceptual  design  of  the  translation  stages  and  their 
requirements  have  already  been  described  in  Chapter  3.  The  transparency 
is  directly  mounted  on  the  large  xy  Stage  Transparency  T^ 
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is  the  reference  transparency  having  a direct  orientation  relationship  to  the 

diode  array.  Hence  I le  measurement  accuracy  of  the  stage  is  important 

from  the  point  of  view  of  defining  the  correlation  areas  on  the  phuie  of  the 

reference  transparency  T . The  transparency  T forming  the  stereo- 

J.  ^ 

pair  is  mounted  on  top  of  an  xy  stage  S which  in  turn  is  mounted  on  the  large 
stage  S . The  stage  S permits  relative  translation  between  transparencies 
Tj  and  T^  which  is  needed  for  parallax  measurement.  For  most  anticipated 
applications  of  this  instrument  the  maximum  relative  translation  between  the 
translation  transparencies  is  expected  to  be  less  than  an  inch.  Hence, 
while  the  stage  S has  to  be  large  so  as  to  hold  the  transparency  T_,  the 
maximum  translation  in  both  xy  direction  need  not  be  greater  than  an  inch. 

The  accuracy  and  precision  of  the  stage  S is  critical  since,  the  measurements 

A 

made  with  Sg  directly  represent  x and  y parallax  values.  The  stages  can 
be  driven  with  stepping  motors  directly  by  the  control  computer  fmd  encoders 
can  be  used  to  provide  positional  information.  The  use  of  encoders  instead  of 
the  stepping  motors  to  obtain  positional  information  on  the  transparencies 
avoids  the  requirement  for  initialization  and  continuous  tracking.  The  trans- 
parencies can  be  mounted  outside  the  instrument  on  plate  holders  such  that 
the  reference  marks  on  the  holders  precisely  coincide  with  the  regular  or  marked 
fiducials  on  the  transparencies.  The  holders  can  be  designed  and  fabricated 
such  that  they  can  be  located  precisely  on  the  stages.  Thus  the  initialization 
and  relative  orientation  of  the  transparencies  on  the  holders  can  be  achieved  easily  outside  of 
the  Instrmnent.  Once  the  coordinate  system  defined  by  fiducials  on  the  trans- 
parency is  aligned  and  located  with  respect  to  the  coordinate  system  of  the 
stages,  the  initialization  of  the  instrument  for  compilation  can  be  achieved 
directly  by  the  control  computer  using  the  aerotriangulation  data.  Hence  the 
operator  interaction  with  the  instrument  during  the  start  up  phase  Involves 
the  relative  alignment  of  the  fiducials  or  other  marked  points  on  the  transparency 
with  the  corresponding  points  on  the  plate  holder. 
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5.2.3  The  Electronic  System 

The  electronic  system  consists  of  the  detector  array,  the  inter- 
face clecti'onics,  the  shutter  control,  the  drive  and  monitoring  electronics 
associated  with  the  translation  stages,  the  phase  modulator,  the  closed  circuit 
T.  V.  Monitor  and  the  control  computer.  The  specifications  and  requirements 
of  these  various  components  are  standard  and  represent  "off-the-shelP* 
technology.  Detailed  discussion  of  the  various  electronic  components  of  the 
system  are  beyond  the  scope  of  this  report.  In  this  section,  the  data  processing 
hardware  requirements  and  the  speed  of  operation  of  the  system  are  discussed, 
so  as  to  demonstrate  the  viability  of  HOC  as  a field  instrument. 

For  the  purpose  of  computing  the  correlation  coefficient  for 
any  given  orientation  behveen  transparencies,  four  sets  of  measurements  of 
the  detector  array  are  required.  Including  the  memory  requirement  for  storing 
the  dark  current  values  for  each  element  of  the  array,  that  represents  a require- 
ment for  12.  5K  of  eight  bit  memory  (bytes).  Once  the  correlation  coefficient  is 
computed  and  processed  the  results  stored  represent  three  sets  of  2500  data 
values  representing  the  maximum  correlation  coefficient,  the  p^  step  at 
which  the  maximum  occurred  and  the  p^  step  at  which  the  minimum  occurred. 
This  part  requires  7.5K  bytes.  Hence  for  computing  the  x and  y parallax 
values  for  a given  50x50  correlation  area  in  the  stero  model,  the  storage 
requirements  can  be  easily  met  by  the  capabilities  of  a minicomputer. 

Since  the  data  corresponding  to  the  entire  stereomodel  represents  300,000 
values.the  x and  y parallax  values  must  be  periodically  transmitted  onto 
magnetic  tape  during  translation  betw'een  one  set  of  correlation  areas  to  another 

within  the  stereomodel. 

The  speed  of  operation  of  the  iKjtentlal  instrument  can  be 
illustrated  by  considering  a hardened  and  field  compatible  minicomputer 
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such  as  PDP  11/34M  as  an  example  for  the  control  computer.  As  stated 
earlier  four  sets  of  intensity  measurements  with  the  detector  array  are 
needed  for  the  computation  of  the  correlation  coefficient.  Consider  the  array 
operating  at  400  KHz  clock  rate.  This  means  that  the  sample  and  hold  and  the 
A/D  converter  must  be  fast  enough  to  obtain  8 bit  A/D  convention  within  2. 5 
microseconds.  The  time  budget  for  the  overall  measurement  is  eomputed  as 
follows ; 


Time  taken  to  read  a frame: 

Assuming  four  frame  averaging, 
the  time  for  one  measurement  is: 

Time  delay  between  subsequent 
measurements : 

Time  for  four  sets  of  measurements : 


6.25  milliseconds 
25  milliseconds 

6.  25  milliseconds 

118.75  milliseconds 


Let  us  now  consider  the  time  required  to  compute  the  correlation  coefficient. 
The  time  required  for  computing  the  correlation  coefficient  at  each  point 
(for  PDP  11/34M)  is  100  microseconds. 


Computation  time  for  the  array: 

Total  time  required  for  each  step: 

Assuming  100  p^^  steps  and  5 p^ 
step,  total  steps: 

Total  time  for  compiling  50x50 
array  of  points  on  the  model 


250  milliseconds 
. 350  milliseconds 

500 

approximately  3 min. 


Nominally  50x50  array  of  correlation  areas  cover  a 25  mm  square  on  the 
model.  There  are  typically  50  such  areas.  The  time  required  for  translation 
between  different  areas  on  the  model  are  insignificant  compared  to  the  comoilntion 
time  for  each  step.  Hence  the  total  anticipated  time  for  computing  the  parallax 
values  for  each  model  (150x200  mm)  Is  approximately  150  minutes. 
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It  is  to  be  omphasi/eci  hei’c  that  the  parallax  values  measured 
refer  to  the  photo-coordinate  system  of  the  stationary  transparency  and  is 
identical  to  the  data  that  can  be  obtained  from  a stereo  comparator.  The 
computation  of  the  ffrounddata  from  the  HOC  data  is  straight  forward  and  has 
been  outlined  in  Reference  ( 3).  It  is  proposed  that  this  data  processing  is  done 
outside  the  HOC  instrument,  probably  using  the  same  control  computer  after 
the  measurement  process. 

5.  3 Data  I^ocessing  Requirements 

As  stated  earlier  the  output  from  the  basic  HOC  system 
represents  the  x and  y parallax  values  of  an  array  of  elemental  correlation 
areas  defined  on  one  of  the  transparencies.  This  data  can  easily  be  reduced 
to  provide  the  coordinates  of  the  corresponding  areas  in  the  second  transparency. 
If  M , M are  the  exterior  orientation  matrices  (object  to  photo)  and  f the 
focal  length,  then  the  coordinates  on  two  equivalent  truly  vertical  photographs 
(assuming  positive  geometry)  are: 


"u" 

Px"! 

V 

1 

y 1 and 

v' 

_w_ 

_-fJ 

_w'_! 

(5.  1) 


when  (x,  y)  Is  the  coordinates  in  photo  1 and  (x',  y’)  is  the  coordinate  in  photo  2. 


Let  X , Y , Z and  X , 
(in  the  object  space)  of  the  two  camera  stations, 
di  nates  of  any  point,  then 


be  the  coordinates 
Z the  object  coor- 
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x-x 


Y-Y 


and 


Y-Y 


= t.. 


Z-Z 


\v 


Z-Z 


w' 


where  t and  t are  scale  facttirs,  which  when  eliminated  lead  to 
X M 


Then, 
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(Z-Z  ) 
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u 

w 
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X 

(Z-Z  ) 
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w' 


X = X ^ u (Z-Z  ) = X ^ iJ'  (Z-Z  ) 
c.  - c’  c„  -7  c„ 
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w' 


u u'  u u' 

Z(-  - 7.  - ^ Z > X - X 

w w'  w Cj  W'  Cg  Cg  Cj 


Z 


uw*  Z - u’w  Z > ww'  B 
uw’  - u'w  ^1  ^2  ^ 


ww' 


ww' 


or 


where  B = X - X 


Z = 


uw'  Z - u'w  Z * ww'  B, 
°1  °2  ^ 
uw'  - u'w 


Y = Y + - (Z-Z  ) = Y ^ ^ (Z-Z  ) 
Cl  w Cl'  Cg  W Cg 


(5.2) 


(5.  3) 


(5.4) 


(5.  5) 


and 
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Equations  5.  3,  5.  4 and  5.  5 may  be  used  to  compute  the  ground 
coordinates  corresponding  to  each  elemental  correlation  area  on  the  transparencies. 

Since  the  ground  coordinates  measured  represent  regularly 
sampled  data  in  the  plane  of  the  transparency,  the  transformed  points  in 
the  object  space  represent  irregularly  sampled  data  points.  It  is  necessary 
for  all  subsequent  utilization  that  this  irregularly  gridded  data  be  converted 
I to  regularly  gridded  data  points.  Also  the  raw  HOC  data  contains  points  at 
which  no  correlation  has  been  performed  due  to  lack  of  image  structure.  It 
is  also  possible  that  some  data  points  measured  might  be  inconsistent  with  the 
nature  of  the  terrain  being  compiled.  Hence  the  processing  of  HOC  data  is 
necessary  not  only  from  the  point  of  view  of  transformation  but  is  also 
required  to  obtain  data  smoothing.  Considerable  work  has  already  been  accom- 
plished with  regard  to  the  problem  of  surface  modeling  (6).  In  these 
techniques  the  surface  is  represented  as  a family  of  locally  valid  mathematical 
functions  which  join  together  continuously.  Either  the  elaborate  discussion  of 
this  procedure  or  its  hardware  requii-ement  are  beyond  the  scope  of  this 
report.  However  it  is  to  be  noted  that  this  problem  has  been  successfully 
handled  as  it  applies  to  automated  cartography  and  hence  is  readily  available 
for  implementation.  This  procedure  permits  one  to  smooth  small  peaks 
and  depressions  caused  either  by  discreteness  of  data  or  by  localized  errors. 

5. 4 Unique  Characterization  of  the  Proposed  HOC  System 

The  unique  characteristics  of  the  proposed  HOC  system  as 
compared  to  other  automated  stereo  compilers  include: 

(a)  In  the  HOC  system  no  operator  Interaction  after  the 
initial  set  up  is  required.  Unlike  the  electronic  correlation 
system,  the  HOC  is  not  a tracking  correlator.  The  ability 
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to  detect  conjugate  image  coincidence  in  any  given  elemental 
area  does  not  in  any  way  depend  on  the  correlat-ability 
of  the  neighboring  elemental  areas.  Hence  the  problem  of 
"getting  lost"  is  irrelevant  to  the  HOC  system.  This  minimizes 
the  operator  intervention. 

(b)  As  an  area  correlation  system  the  HOC  is  potentially 
capable  of  greater  accuracy  and  reduced  uncertainty  in  parallax 
measurement,  however  this  remains  to  be  orovsn.  The  demon- 
strated accuracy  in  parallax  measurement  under  conditions  of 
ideal  imagery  is  about  5 micrometers. 

(c)  Because  of  the  simplicity  of  construction  and  operation 
the  HOC  system  is  potentially  less  expensive  and  easier  to 
maintain  than  more  complex  electronic  correlators. 

(d)  It  is  feasible  to  use  microprocessors  instead  of  mini- 
computers to  control  the  HOC  operation  and  data  management, 
at  the  expense  of  reduced  operational  speed.  Hence  the  entire 
system  can  be  made  as  compact,  rugged  and  portable  as  a 
mechanical  plotter. 

(e)  Finally  the  HOC  system  is  based  on  a detection  concept 
that  is  analytically  superior  to  one-dimensional  electronic 
correlation  system.  The  components  and  the  technology  proposed 
are  being  continuously  Improved  in  terms  of  cost  and  performance. 
Hence  the  HOC  system  development  will  be  edns latent  with 

the  trend  in  technology. 


i 
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6 CONCLUSIONS  AND  RECOMMENDATIONS 

6. 1 Introduction 

This  report  summarizes  results  of  the  design  and  feasibility 
study  of  HOC  as  a van  mounted  stereomodel  digitizer.  In  this  report  the  system 
model  of  the  HOC  used  for  evaluation  has  been  described  and  the  applicability 
and  the  feasibility  of  HOC  system  under  field  conditions  have  been  evaluated. 

Based  on  the  results  of  the  study  a follow-on  prototype  design  for  the  field 
compatible  HOC  system  has  been  proposed.  In  this  chapter  the  conclusions 
of  this  investigation  are  listed  and  the  specific  recommendations  are  outlined. 

The  results  of  this  investigation  support  the  following  general 

conclusions; 

(a)  It  seems  feasible  that  a HOC  system  can  be  configured 
to  be  small,  compact  and  rigid  to  be  used  as  a van  mounted 
stcreomodel  digitizer. 

(b)  An  evaluation  of  the  optical  and  mechanical  subsystems 
Indicate  that  a potential  HOC  system  can  be  made  less  sensitive 
to  mechanical  and  thermal  instabilities  inherent  in  any  field 
applications. 

(c)  The  control  and  processing  requirements  of  the  HOC 
arc  simple  enough  to  be  handled  by  a minicomputer  that  is 
compatible  for  van  mounted  operation. 

(d)  The  proposed  system  approach  to  HOC  system  configuration 
Is  such  to  limit  its  ability  to  handle  imagery  in  which  the  scales 

of  conjugate  images  are  highly  disslmlliar.  While  this  limitation 
does  not  exclude  panoramic  input,  the  HOC  system  as  proposed 
will  not  be  able  to  handle  highly  convergent  inputs.  However 
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the  convergent  inputs  can  be  rectified  in  an  off  line  mode 
before  compilation  by  the  HOC  system.  This  proposed  in- 
flexibility of  the  HOC  represents  the  price  paid  for  achieving 
a more  field  compatible  and  simple  instrument, 

(e)  The  control  and  data  processing  requirements  of  the 
proposed  system  are  neither  large  nor  complex.  The  speed 
of  operation  of  the  instrument  in  light  of  the  simplicity  of  the 
data  processing  hardware  used  represents  a major  advantage. 

(f)  Finally,  the  overall  evaluation  of  this  study  indicates 
that  the  HOC  is  not  only  feasible  but  has  many  unique  advantages 
in  its  application  as  a van  mounted  stereomodel  digitizer. 

6. 2 Recommendations 

The  specific  recommendations  of  this  study  are; 

(a)  A follow-on  prototype  HOC  system  should  be  designed 
fabricated.  An  exhaustive  "field"  evaluation  of  such  a system 
would  clearly  demonstrate  the  conclusions  of  this  report. 

(b)  Evaluate  the  applicability  of  the  off-line  orthoprinter 
as  a general  purpose  input  transparency  rectifier  for  the  HOC 
system.  The  preprocessing  of  the  input  transparency  has  many 
advantages  interms  of  improved  signal  to  noise  ratio  in  coincidence 
detection,  uniformity  of  accuracy  and  simplicity  of  the  over 
system  requirements. 

This  study  has  revealed  that  a HOC  system  has 
great  potential  as  a van  mounted  stereomodel  digitizer.  The 
construction  and  evaluation  of  the  follow-on  prototype  HOC 
system  will  demonstrate  its  advantages  over  other  competitive 
systems  particularly  in  a field  environment. 
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